TEACh: Task-Driven Embodied Agents That Chat
نویسندگان
چکیده
Robots operating in human spaces must be able to engage natural language interaction, both understanding and executing instructions, using conversation resolve ambiguity correct mistakes. To study this, we introduce TEACh, a dataset of over 3,000 human-human, interactive dialogues complete household tasks simulation. A Commander with access oracle information about task communicates Follower. The Follower navigates through interacts the environment varying complexity from "Make Coffee" "Prepare Breakfast", asking questions getting additional Commander. We propose three benchmarks TEACh embodied intelligence challenges, evaluate initial models' abilities dialogue understanding, grounding, execution.
منابع مشابه
Papetto: Embodied Co-Presence in Video Chat
In this paper, we describe Papetto, a lightweight robotic arm that moves according to face detection techniques in order to mirror facial movements such as head shaking, leaning and tilting. Using this system we examine the role of the “frame” in video chat and how embodied co-presence is defined and bounded through lightweight robotic mirroring to enable new forms of engagement in remote commu...
متن کاملEvaluating Data-Driven Style Transformation for Gesturing Embodied Agents
This paper presents an empirical evaluation of a method called Style transformation which consists of modifying an existing gesture sequence in order to obtain a new style where the transformation parameters have been extracted from an existing captured sequence. This data-driven method can be used either to enhance key-framed gesture animations or to taint captured motion sequences according t...
متن کاملBuilding Neuromorphic Embodied Cell Assembly Agents that Learn
Neuromorphic embodied cell assembly agents that learn are one application being developed for the Human Brain Project (HBP). The HBP will build tools, available for all researchers, for building brain simulations. Existing simulated neural agents will be translated to the platforms provided by the HBP; these agents will then run on neuromorphic chips instead of a von Neumann based computer. The...
متن کاملCan You Teach an Old Dog New Tricks? How Older Adults Perceive Embodied Agents
In this experiment we investigate how older adults perceive an embodied agent as compared to younger people in the context of an information giving task. Our results show that older adults found the agent less friendly and likeable than the younger participants in our experiment, and that they had a strong preference for a human presenter. However, the older adults were relatively positive on s...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2022
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v36i2.20097